AURORA MARKET RESEARCH

Author

Joseph H

1 Intoduction

Hello, I’m Joseph from Morocco.

Inspired by Hans Rosling’s TED Talk, I taught myself data scraping, analysis, and visualization.
This non-academic approach has given me a unique perspective, as reflected in my projects—though it also means I may require a thorough onboarding process to align with team standards.

I’m open to starting as an intern, either full-time or part-time. Regarding time zones, I’m in UTC+1, but I’m flexible and can adjust my schedule to accommodate the team’s needs.

Feel free to reach me at joseph.ergo@proton.me, and to visit my website for more projects josephelhaddad.github.io.

This custom report, generated from processing 1.4 TB of public data locally, aims to explore the workforce dynamics of a company—up to 2020.
Essentially, I am doing research on a company that does research.

2 About the project

The project came to life after realizing that web scraping doesn’t allow deep-level filtering—without consuming too much time.The irony is, this project itself took me about a month, but the final RDB contains more data than I could ever scrape.

The raw data was 1.4 TB in size and holds information previously scraped.
Processing was done on my local machine using Python, Polars, and DuckDB, following this workflow:
- Processed raw data into structured Parquet files using Polars.
- Transformed each Parquet file into mini RDBs using Polars.
- Merged all mini RDBs into one using DuckDB.
- Analyzed and filtered data to fit the current project.

Alt text

3 EDA

3.1 market research indestry’s yearly new recruit count

3.2 aurora market research’s workforce status over the years

4 Workforce sample

4.1 Adrian Ward

Job title: Research executive
Associated: False
Socials: https://linkedin.com/in/adrian-ward-81b2768 | https://linkedin.com/in/adrianward2017

4.1.1 Adrian Ward’s working period at aurora market research

4.1.2 Gantt plot of Adrian Ward’s experience

4.2 Ben Cookman

Job title: Senior research executive
Associated: False
Socials: https://linkedin.com/in/ben-cookman-0b6a0423 | https://facebook.com/ben.cookman

4.2.1 Ben Cookman’s working period at aurora market research

4.2.2 Gantt plot of Ben Cookman’s experience

4.3 Catherine King

Job title: Panel manager
Associated: True
Socials: https://linkedin.com/in/catherine-king-838ba336

4.3.1 Catherine King’s working period at aurora market research

4.3.2 Gantt plot of Catherine King’s experience

4.4 Dan Brilot

Job title: Head of client and panel services
Associated: False
Socials: https://linkedin.com/in/danbrilot | https://twitter.com/brilotd | https://linkedin.com/in/dan-brilot-73bb493

4.4.1 Dan Brilot’s working period at aurora market research

4.4.2 Gantt plot of Dan Brilot’s experience

4.5 Emma Norman

Job title: Panel manager
Associated: False
Socials: https://linkedin.com/in/emma-norman-b1a983a

4.5.1 Emma Norman’s working period at aurora market research

4.5.2 Gantt plot of Emma Norman’s experience

4.6 Judy Ovens

Job title: Market research consultant
Associated: True
Socials: https://linkedin.com/in/judy-ovens-b68a34172

4.6.1 Judy Ovens’s working period at aurora market research

4.6.2 Gantt plot of Judy Ovens’s experience

4.7 Justin Alderson

Job title: Owner
Associated: True
Socials: https://linkedin.com/in/justin-alderson-4b010b2

4.7.1 Justin Alderson’s working period at aurora market research

4.7.2 Gantt plot of Justin Alderson’s experience

4.8 Kelly Fitzgerald

Job title: Manager
Associated: True
Socials: https://linkedin.com/in/kelly-fitzgerald-58bb932

4.8.1 Kelly Fitzgerald’s working period at aurora market research

4.8.2 Gantt plot of Kelly Fitzgerald’s experience

4.9 Kiertan Rourke

Job title: Research manager
Associated: False
Socials: https://linkedin.com/in/kiertan-rourke-89a74079

4.9.1 Kiertan Rourke’s working period at aurora market research

4.9.2 Gantt plot of Kiertan Rourke’s experience

4.10 Louise Bonnici

Job title: Associate director
Associated: True
Socials: https://linkedin.com/in/louiseainslie

4.10.1 Louise Bonnici’s working period at aurora market research

4.10.2 Gantt plot of Louise Bonnici’s experience

4.11 Lukas Revzin

Job title: Research executive
Associated: False
Socials: https://linkedin.com/in/lukas-revzin-00318242

4.11.1 Lukas Revzin’s working period at aurora market research

4.11.2 Gantt plot of Lukas Revzin’s experience

4.12 Melissa Martin

Job title: Panel executive
Associated: False
Socials: https://linkedin.com/in/melissa-martin-69008b94

4.12.1 Melissa Martin’s working period at aurora market research

4.12.2 Gantt plot of Melissa Martin’s experience

4.13 Nora Butkute

Job title: Assistant
Associated: True
Socials: https://linkedin.com/in/nora-butkute-42708283

4.13.1 Nora Butkute’s working period at aurora market research

4.13.2 Gantt plot of Nora Butkute’s experience

4.14 Nora Butkute

Job title: Assistant
Associated: False
Socials: https://linkedin.com/in/nora-butkute-707080109

4.14.1 Nora Butkute’s working period at aurora market research

4.14.2 Gantt plot of Nora Butkute’s experience

4.15 Peter Hershel-Jones

Job title: Sales manager
Associated: False
Socials: https://linkedin.com/in/peter-hershel-jones-a3a8872

4.15.1 Peter Hershel-Jones’s working period at aurora market research

4.15.2 Gantt plot of Peter Hershel-Jones’s experience

4.16 Steven Jones

Job title: Panel manager
Associated: False
Socials: https://linkedin.com/in/steven-jones-7516a438